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FOREWORD 


The  Army  Research  Institute  Aviation  Research  and  Develop¬ 
ment  Activity  (ARIARDA)  at  Fort  Rucker,  Alabama,  is  an  opera¬ 
tional  unit  of  the  U.S.  Army  Research  Institute  for  the  Behav¬ 
ioral  and  Social  Sciences  (ARI) .  This  work  was  performed  within 
the  Systems  Research  Laboratory  portion  of  ARIARDA 's  research 
mission.  Research  is  conducted  in-house  and  is  augmented  by  on¬ 
site  contract  support  as  required.  This  report  documents  work 
that  supports  the  U.S.  Army  Aviation  Systems  Command  (AVSCOM)  at 
St.  Louis,  Missouri.  The  work  was  performed  under  the  Memoranduii 
of  Understanding  between  AVSCOM  and  ARI,  "Establishment  of  Tech¬ 
nical  Coordination  Between  ARI  and  AVSCOM,"  10  April  1985. 

The  potential  impact  of  advanced  technology  on  manpower  and 
personnel  requirements  must  be  considered  when  planning  system 
modifications.  Since  high  operator  workload  can  result  in  a 
dramatic  decrease  in  system  effectiveness,  the  impact  of  advanced 
technology  on  workload  for  the  system  operator (s)  is  a  critical 
consideration. 

This  three-volume  report  describes  the  methodology  used  to 
conduct  a  comprehensive  task  analysis  of  the  MH-60K  mission  and 
gives  the  results  of  the  analysis.  Information  provided  by  the 
MH-60K  mission/task/workload  analysis  was  used  to  establish  a 
data  base  and  to  develop  a  computer  model  that  predicts  workload 
for  the  MH-60K  pilot  and  copilot.  Assessments  of  workload  pro¬ 
duced  by  the  models  are  compared  with  the  UH-60A  baseline  model 
to  assess  the  impact  on  workload  of  the  high  technology  modifica¬ 
tions  made  in  the  MH-60K  aircraft. 

Volume  I  describes  the  methodology  and  summarizes  the 
results  of  the  research.  Volume  II  of  the  reports  contains 
Appendixes  A  through  G  and  presents  the  results  of  exercising  the 
UH-60A  baseline  model  and  the  MH-60K  mission/task/workload  anal¬ 
ysis.  Volume  III  contains  Appendixes  H  through  N.  The  informa¬ 
tion  presented  in  Appendixes  H  through  K  is  sufficient  to  simu¬ 
late  the  crewmembers'  actions  during  the  MH-60K  mission. 

During  the  avionics  design  for  the  "K"  model,  a  series  of 
aircrew  station  reviews  was  held  among  the  Program  Manager's 
Office,  AVSCOM;  Special  Operation  Forces,  Fort  Campbell,  Ken¬ 
tucky;  and  the  Sikorsky  Aircraft  Division  to  review  design 
specifications  and  assess  their  impact  on  the  crew  station. 
Specific  briefings  on  this  methodology  were  provided  to  the  CH-47 
and  UH-60  Program  Offices  at  AVSCOM  and  to  individuals  in  the 
following  organizations;  Sikorsky  Aircraft,  Stratford,  Connect¬ 
icut;  IBM,  Poughkeepsie,  New  York;  and  Boeing  Helicopter  Company 
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of  Pennsylvania.  In  addition,  individual  briefings  were  given  to 
representatives  of  AVSCOM,  ARI .  and  Sikorsky  Aircraft.  The 

computer-supported  methodology  has  been  used  to  assess  operator 
workload  in  a  number  of  Army  modeling  systems. 


EDGAR  M.  'JOHNSON 
Technical  Director 
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TASK  ANALYSIS  AND  WORKLOAD  PREDICTION  MODEL  OF  THE  MH-60K  MISSION 
AND  A  COMPARISON  WITH  UH-60A  WORKLOAD  PREDICTIONS 

Volume  I:  Summary  Report 


EXECUTIVE  SUMMARY 


Requirement: 

The  research  reported  in  this  three-volume  document  was 
conducted  by  the  U.S.  Army  Research  Institute  Aviation  Research 
and  Development  Activity  (ARIARDA)  to  evaluate  the  impact  that 
proposed  modifications  for  the  MH-60K  aircraft  will  have  on  crew 
workload  when  compared  to  the  crew  workload  of  the  UH-60A. 

The  concern  in  conducting  the  analyses  was  that  high  tech¬ 
nology  modifications  being  proposed  for  the  existing  aircraft 
systems  may  increase  workload  by  placing  additional  demands  on 
the  mental  resources  of  the  crewmembers.  The  primary  require¬ 
ments  of  the  research  were  to  conduct  a  detailed  analysis  of  the 
operator  tasks  that  must  be  performed  during  the  MH-60K  combat 
mission,  to  develop  a  computer  model  that  predicts  MH-60K  opera¬ 
tor  workload,  and  to  compare  the  MH-60K  operator  workload  pre¬ 
dictions  with  the  UH-60A  baseline  operator  workload  predictions. 


Procedure : 

Anacapa  Sciences  personnel,  under  contract  to  ARIARDA, 
developed  a  methodology  for  predicting  operator  workload  during 
the  conceptual  phase  of  system  development  for  ■‘■he  ArTny^c  T.-'‘oht 
Helicopter  Family  (LHX)  aircraft.  The  LHX  workload  prediction 
methodology  has  been  refined  and  used  to  develop  baseline  models 
to  predict  workload  encountered  by  operators  of  the  AH-64A  and 
UH-60A  aircraft.  Whereas  the  LHX  model  was  based  on  a  generic 
analysis  of  an  aircraft  in  the  conceptual  design  phase  of  devel¬ 
opment,  the  AH-64A  and  UH-60A  models  are  based  on  analyses  of 
existing  systems.  Consequently,  the  workload  analyses  of  the  AH- 
64A  and  UH-60A  were  conducted  at  a  much  more  detailed  level  than 
the  LHX  workload  analysis.  The  refined  workload  prediction 
methodology  has  been  named  the  Task  Analysis/Workload  (TAWL) 
methodology.  The  TAWL  methodology  was  used  to  meet  the  follow¬ 
ing  technical  objectives: 

•  produce  estimates  of  operator  workload  during  the  UH-60A 
combat  mission; 
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•  identify  the  phases,  segments,  functions,  and  tasks  in  the 
MH-60K  combat  mission; 

•  identify  the  crewmember (s)  performing  each  task; 

•  estimate  the  workload  associated  with  the  sensory, 
cognitive,  and  psychomotor  components  of  each  task; 

•  estimate  the  temporal  sequence  and  duration  of  each  task, 

•  identify  the  subsystem (s)  representing  the  man-machine 
interface  for  each  task; 

•  develop  decision  rules  for  combining  the  tasks  into 
functions  and  for  combining  the  functions  into  segments; 

•  utilize  the  TAWL  Operator  Simulation  System  (TOSS) 
software  to  produce  predictions  of  MH-60K  operator 
workload;  and 

•  compare  the  MH-60K  predicted  operator  workload  with  the 
UH-60A  predicted  operator  workload. 


Findings ; 

A  total  of  5  phases,  15  unique  segments,  71  unique  func¬ 
tions,  and  230  unique  tasks  were  identified  in  the  MH-60K 
mission/task/worklc''d  fn-''’vs’s.  Under  the  conditions  that  the 
model  was  developec  (e.g.,  proficient  operators,  optimal  weather 
conditions)  ,  neithe’'  che  UH  -60^  nor  the  MH-60K  appear  to  place 
excessive  workload  demands  on  the  operators.  A  comparison  of  the 
pilot  workload  for  the  MH-60K  and  the  UH-60A  resulted  in  the 
following  observations: 

•  The  MH-60K  aircraft  had  higher  nighc-vision  goggle  (hVC) 
workload  than  the  UH-60A.  The  increase  in  external  visual 
attention  may  provide  the  IIH-60K  pilot  with  increased 
awareness  of  the  status  and  spatial  location  of  the 
aircraft,  of  other  air  traffic,  and  of  threats  to  the 
aircraft. 

•  The  MH-60K  aircraft  had  lower  visual  workload  because  of 
the  reduction  of  aircraft  system  monitoring,  which  is 
automatically  performed  by  the  integrated  avionics 
subsystems . 

•  The  MH-60K  aircraft  had  reduced  kinesthetic  and  psycho¬ 
motor  workload  when  flight  controls  are  coupled. 
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•  ihe  overall  workload  in  the  MH-60K  was  similar  to  the  UH- 
60A  in  all  segments  except  when  the  controls  are  coupled 
in  the  MH-60K. 

A  comparison  of  the  copilot  workload  for  the  MH-60K  and  the 
UH-60A  resulted  in  the  following  observations: 

•  The  MH-60K  aircraft  had  reduced  visual  workload  because  of 
the  reduced  requirements  for  map  interpretation.  The 
position  is  always  readily  available  on  the  multifunction 
displays  (MFDs) . 

•  The  MH-60K  aircraft  had  higher  NVG  workload  than  the  UH- 
60A.  The  increase  in  external  visual  attention  may  pro¬ 
vide  the  MH-60K  copilot  witn  increased  awareness  of  the 
status  and  spatial  location  of  the  aircraft,  other  air 
traffic,  and  threats  to  the  aircraft. 

•  The  MH-60K  had  lower  cognitive  workload  because  functions 
such  as  fuel  consumption,  checking  system  status,  and 
determining  present  position  are  performed  continuously  by 
the  mission  processor. 

•  The  overall  workload  in  the  MH-60K  was  generally  lower 
than  the  overall  workload  in  UH-60A. 


Utilization  of  Findings: 

The  predicted  effect  of  the  MH-60K  modifications  on  operator 
workload  can  be  used  in  making  human  engineering  design  decisions 
(i.e.,  is  more  automation  needed).  In  addition,  the  task  analy¬ 
sis  data  should  prove  useful  in  identifying  training  requirements 
for  the  MH-60K  aircraft.  An  analysis  of  the  tasks  to  be  per¬ 
formed  and  the  associated  components  within  each  task  will  allow 
the  trainer  to  determine  the  methods  of  instruction  needed  and 
the  equipment  necessary  for  conducting  the  training. 
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Task  Analysis  and  Workload  Prediction  Model  of  the 
MH-60K  Mission  and  a  Comparison  with  UH-60A 
Workload  Predictions 

INTRODUCTION 

The  Special  Opeiations  Forces  (SOF)  Aviation  Project 
Office  at  the  Army  Aviation  Systems  Command  (AVSCOM)  has  been 
tasked  to  modify  existing  UH-60A  aircraft  for  SOF  missions. 
The  aircraft,  designated  the  MH-60K,  will  be  modified  by 
replacing  present  instrumentation  with  a  fully  integrated 
cockpit  featuring  four  multifunction  displays  (MFDs) .  The 
modifications  include: 

•  terrain  avoidance/terrain  following  radar, 

•  forward-looking  infrared  (FLIR)  capability, 

•  flight  symbology  on  the  Aviator's  Night  Vision  Imaging 
System  (ANVIS) , 

•  improved  navigation  capability,  including  global  posi¬ 
tion  system  (GPS)  and  continuous  present  position 
display, 

•  improved  flight  control  with  all  axes  coupled  to  the 
mission  computer, 

•  map  display  on  the  MFDs,  and 

•  air-to-air  refueling  capability  with  automatic  fuel 
consumption  display. 

The  modifications  being  prepared  for  the  MH-60K  aircraft 
are  designed  to  increase  operational  effectiveness  and  to 
reduce  operator  workload  during  SOF  missions.  The  increased 
mission  capabilities  of  the  MH-60K  aircraft  have  dramatically 
increased  the  amount  of  display  information  available  to  the 
operators  and  may  increase  operator  workload  by  placing  addi¬ 
tional  demands  on  the  cognitive  resources  of  the  crewmembers. 
Although  many  tasks  performed  by  the  operators  in  the  UH-60A 
have  been  automated  in  the  MH-60K  aircraft,  technology  that 
reduces  an  operator's  need  to  maintain  physical  control  of 
system  functions  often  increases  the  operator' s  role  as  a 
monitor.  Thus,  in  some  instances,  automation  may  simply 
change  the  nature  of  the  task  without  decreasing  operator 
workload . 

A  mission/task/workload  analysis  was  needed  to  assess 
the  impact  of  the  MH-60K  aircraft  modifications  and  the  SOF 
mission  on  crew  workload.  The  SOF  Aviation  Project  Office 
requested  that  the  Army  Research  Institute  Aviation  Research 
and  Development  Activity  (ARIARDA)  use  the  Task  Analysis/ 
Workload  (TAWL)  prediction  methodology  to  (a)  conduct  a 
mission/task  analysis  for  the  UH-60A  and  MH-60K  aircraft,  (b) 
produce  workload  predictions  for  the  UH-60A  and  MH-60K 
aircraft,  and  (c)  compare  the  workload  in  the  MH-60K  with 
workload  in  the  UH-60A. 
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The  TAWL  Methodology 


Under  contract  to  ARIARDA,  Anacapa  Sciences  personnel 
developed  TAWL  for  predicting  operator  workload.  Initially, 
the  methodology  was  used  to  address  design  issues  for  the 
Army' s  Light  Helicopter  Family  (LHX)  aircraft  (Aldrich, 
Craddock,  &  McCracken,  1984;  McCracken  &  Aldrich,  1984).  The 
methodology  was  later  refined  and  used  to  develop  a  model  of 
operator  workload  for  the  AH-64A  aircraft  (Szabo  &  Bierbaum, 
1986) .  Bierbaum,  Fulford,  and  Hamilton  (1989)  provided  a 
complete  description  of  the  TAWL  prediction  methodology  and 
its  computer  support.  The  remainder  of  this  subsection 
presents  an  overview  of  the  latest  version  of  the  TAWL 
methodology . 

A  TAWL  workload  prediction  model  is  developed  in  three 
stages.  In  the  first  stage,  the  analyst  performs  a  task/ 
workload  analysis  on  the  system.  A  prototype  mission  for  the 
system  is  developed  and  is  progressively  decomposed  into 
phases,  segments,  functions,  and  tasks.  The  analysis  yields 
estimates  of  the  duration  of  tasks,  a  description  of  the 
sequence  of  tasks,  and  a  description  of  the  crewmember  and 
subsystem  associated  with  each  task.  The  workload  analysis 
is  based  on  a  multiple  resources  theory  of  human  attention 
and  yields  independent  estimates  of  the  cognitive,  psycho¬ 
motor,  and  sensory  components  of  workload  (hereafter  referred 
to  as  workload  components)  for  each  task.  The  theory  differs 
from  other  multiple  resource  theories  of  attention  in  the 
nature  and  number  of  components  identified  in  the  theory. 

For  a  review  of  other  multiple  resources  theories  of  atten¬ 
tion  and  their  relation  to  workload,  see  Wickens  (1984). 

The  TAWL  methodology  treats  each  of  the  workload  compo¬ 
nents  independently  for  two  reasons.  First,  although  inter¬ 
actions  between  the  components  probably  occur,  adequate 
definitions  of  the  nature  of  the  interactions  do  not  exist. 
Second,  the  additional  information  that  results  from  treating 
workload  components  individually  is  useful  for  determining 
appropriate  ways  to  reduce  workload  or  to  redistribute  work¬ 
load  among  the  crewmembers,  subsystems,  or  components.  For 
example,  a  designer  could  decide  whether  additional  informa¬ 
tion  should  be  presented  visually  or  aurally  by  determining 
which  component  had  the  least  amount  of  workload. 

The  workload  analysis  is  based  upon  subjective  estimates 
of  operator  workload  rather  than  estimates  derived  through 
experimentation.  The  research  analysts  and  MH-60  subject 
matter  experts  (SMEs)  generated  workloa  estimates  by  using 
equal-interval,  verbally  anchored  rating  scales;  the  scale 
values  range  from  1.0  to  7.0.  This  approach  avoids  the 


2 


expense  in  time,  money,  and  manpower  required  to  derive 
empirical  measures  of  workload. 


In  the  second  stage  of  the  TAWL  methodology,  the  analyst 
develops  a  model  of  each  crewmember's  actions  by  recombining 
tasks  to  simulate  the  behavior  of  the  crewmembers  during  each 
segment  of  the  mission.  Function  decision  rules  are  devel¬ 
oped  that  describe  the  sequencing  of  tasks  in  functions; 
segment  decision  rules  are  developed  that  describe  the 
sequencing  of  functions  in  segments.  It  is  assumed  that  the 
segments  can  be  combined  to  model  the  crewmember's  behavior 
for  individual  phases  and  for  the  entire  mission. 

In  the  third  stage  of  the  TAWL  methodology,  the  analyst 
executes  the  model  to  simulate  the  crewmembers'  actions 
during  the  operation  of  the  system.  The  TAWL  Operator  Simu¬ 
lation  System  (TOSS)  computer  software  performs  the  simula¬ 
tion  and  produces  estimates  of  each  crewmember's  cognitive, 
psychomotor,  and  sensory  workload  for  each  half-second  of  the 
mission.  The  estimates  of  workload  for  each  component  are 
generated  by  summing  the  workload  for  that  component  across 
all  tasks  that  the  crewmember  performs  concurrently  during 
each  half-second  of  the  mission.  For  example,  during  a 
specific  half-second  interval,  the  pilot  performs  the  tasks: 
Control  Attitude,  Check  External  Scene,  and  Transmit  Communi¬ 
cation.  The  cognitive  workload  for  the  three  tasks  during 
that  interval  is  1.0,  1.0,  and  5.3,  respectively.  Thus,  the 
estimate  of  cognitive  workload  for  the  pilot  during  that 
interval  is  7.3. 

A  criterion  that  represents  an  estimate  of  the  overload 
threshold  is  used  during  execution  of  the  model  to  produce 
estimates  of  the  amount  of  time  during  the  mission  that  each 
crewmember  experiences  an  overload  condition. 

Using  the  TAWL  prediction  methodology,  an  analyst  can 
develop  a  model  of  a  system  and  use  the  model's  output  to 
determine : 

•  the  absolute  and  relative  workload  of  the  crewmember, 

•  the  time  intervals  (in  half-second  minimum  intervals) 
during  which  crewmembers  experience  high  workload,  and 

•  the  components  for  which  crewmembers  experience  high 
workload . 

The  information  yielded  by  the  TAWL  methodology  may 
enable  system  designers  to  reduce  workload  or  to  redistribute 
workload  over  time,  crewmembers,  or  components.  Designers 
also  may  use  the  information  to  identify  design  alternatives 
that  result  in  lower  workload. 
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In  addition  to  the  uses  described  above,  the  methodology 
yields  mission  time  lines  and  task  listings  (at  half-second 
intervals)  that  can  be  used  to  develop  the  system's  manning 
and  training  requirements. 


Overview 

The  research  described  in  this  report  is  designed  to 
address  the  issues  of  workload  in  the  MH-60K  aircraft.  To 
place  the  MH-60K  workload  predictions  in  perspective  relative 
to  other  similar  aircraft,  a  baseline  workload  prediction 
model  was  prepared  for  the  UH-60A  aircraft.  The  task/ 
workload  analysis  and  model  construction  phases  of  the  UH-60A 
baseline  model  were  described  in  a  report  by  Bierbaum,  Szabo, 
and  Aldrich  (1989) .  Thus,  the  present  research  has  the 
following  objectives: 

•  exercise  the  UH-60A  model  to  produce  estimates  of 
operator  workload  during  the  UH-60A  combat  mission, 

•  produce  an  analysis  of  the  tasks  that  must  be  per¬ 
formed  to  accomplish  the  MH-60K  combat  mission, 

•  develop  a  computer  model  to  predict  MH-60K  operator 
workload, 

•  exercise  the  MH-60K  model  to  produce  estimates  of 
operator  workload  during  the  MH-60K  mission,  and 

•  compare  the  MH-60K  operator  workload  predictions  with 
the  UH-60A  baseline  operator  workload  predictions. 

The  research  is  reported  in  three  volumes.  Volume  I 
summarizes  the  methods  and  results  of  the  research.  Volume 
II  comprises  Appendixes  A  through  G,  which  present  the  work¬ 
load  predictions  of  the  UH-60A  baseline  model  and  contain  the 
data  produced  during  the  task/workload  analysis  of  the  MH-60K 
aircraft.  Volume  III  comprises  Appendixes  H  through  N,  which 
contain  the  data  produced  during  the  construction  of  the  MH- 
60K  model,  the  workload  predictions  of  the  MH-60K  model,  and 
a  comparison  list  of  the  segment  and  function  names  in  the 
UH-60A  and  the  MH-60K  models. 
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ANALYSIS  I 


THE  UH-60A  WORKLOAD  PREDICTION  MODEL 


Bierbaum,  Szabo  and  Aldrich  (1989)  conducted  a  mission/ 
task  analysis  of  the  UH-60A  aircraft  identifying  9  mission 
phases,  34  segments,  48  functions,  and  138  tasks.  The 
results  of  the  mission/task  analysis  were  used  to  develop  a 
workload  prediction  model.  The  results  from  exercising  the 
microcomputer-based  UH-60A  workload  prediction  model  devel¬ 
oped  by  Bierbaum,  Szabo,  and  Aldrich  are  reported  below,  and 
the  results  of  the  analysis  provide  a  baseline  against  which 
to  compare  the  workload  predictions  for  the  MH-60K  aircraft. 


Method 

The  analysts  used  the  TOSS  software  to  automate  the  data 
entry  and  execute  the  UH-60A  workload  model;  the  steps 
required  to  implement  the  model  are  fully  described  by 
Bierbaum,  Fulford,  and  Hamilton  (1989)  and  are  briefly  summa¬ 
rized  here.  The  task  names,  subsystems,  and  workload  esti¬ 
mates  from  the  task/workload  analysis  stage,  and  the  function 
and  segment  decision  rules  from  the  model  construction  stage 
of  the  UH-60A  analysis  (Bierbaum,  Szabo,  &  Aldrich,  1989), 
were  entered  into  TOSS  using  the  data  entry  routines  of  the 
system.  Then,  each  of  the  34  unique  segments  of  the  model 
was  simulated.  As  mentioned  above,  TOSS  computes  the  total 
workload  for  each  component  for  each  crewmember;  workload  is 
computed  at  half-second  intervals  throughout  the  mission 
segment . 

At  the  end  of  the  simulation  of  each  segment,  TOSS  was 
used  to  compute  several  descriptive  statistics  (peak,  mean, 
and  standard  deviation)  for  the  half-second  workload  predic¬ 
tions  .  In  addition,  TOSS  was  used  to  identify  the  intervals 
in  the  mission  segment  during  which  the  performance  of  con¬ 
current  tasks  resulted  in  excessive  workload  (referred  to 
hereafter  as  overload) .  Four  specific  indexes  of  overload, 
as  defined  by  Aldrich,  Craddock,  and  McCracken  (1984)  and 
Szabo  and  Bierbaum  (1986),  were  computed  by  TOSS;  these 
indexes  of  overload  are  described  in  the  following 
paragraphs . 


Component  Overload 

A  component  overload  occurs  when  the  total  workload  for 
a  single  component  reaches  or  exceeds  a  value  of  8  during  a 
half-second  interval  of  the  mission  simulation.  Thus,  as 
many  as  six  component  overloads  (i.e.,  cognitive,  psycho¬ 
motor,  visual-aided,  visual-unaided,  auditory,  and 
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kinesthetic)  may  occur  for  each  half-second  interval  on  the 
mission  timeline.  The  value  8  was  chosen  as  the  overload 
threshold  because  it  exceeds  the  maximum  value  on  the  7-point 
workload  component  rating  scales. 


Overload  Condition 

An  overload  condition  exists  when  at  least  one  component 
overload  occurs.  An  overload  condition  is  a  variable-length 
period  that  contains  at  least  one  component  overload.  A  new 
overload  condition  is  counted  whenever  the  tasks  contributing 
to  a  component  overload  change.  Overload  conditions  identify 
the  unique  conditions  within  a  mission  segment  associated 
with  a  component  overload. 


Overload  Density 

Overload  density  is  the  percentage  of  time  during  a 
mission  segment  that  a  component  overload  is  present .  It  is 
calculated  by  dividing  the  number  of  half-second  intervals  in 
a  mission  segment  that  contain  component  overloads  by  the 
total  number  of  half-second  intervals  in  the  segment. 


Subsystem  Overload 

Subsystem  overload  is  the  number  of  half-second  intervals 
that  a  subsystem  is  associated  with  a  component  overload.  All 
subsystems  associated  with  the  tasks  being  performed  during  a 
component  overload  are  assigned  an  overload.  The  tallies  of 
subsystem  overloads  identify  the  subsystems  that  are 
associated  with  high  workload. 


Overall  Workload 

lavecchia,  Linton,  Bittner,  and  Byers  (1989)  conducted 
research  to  determine  the  validity  of  the  UH-60A  workload 
prediction  model.  The  researchers  obtained  subjective  rat¬ 
ings  of  overall  workload  (OW)  for  pilots  performing  a  typical 
UH-60A  mission  in  the  UH-60A  flight  simulator.  During  mis¬ 
sion  segments,  pilots  provided  ratings  of  their  workload 
using  a  continuous  scale  that  ranged  from  0  to  100,  with  the 
extreme  values  verbally  anchored  to  "Very  Low  Workload"  and 
"Very  High  Workload."  To  establish  the  validity  of  the  UH- 
60A  workload  prediction  model,  the  observed  OW  measures  were 
compared  to  the  workload  predictions  produced  by  the  model. 
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However,  the  UH-60A  workload  prediction  model  produces  pre¬ 
dictions  of  workload  independently  for  six  workload  compo¬ 
nents  and  does  not  produce  a  single  overall  estimate  of 
workload.  To  compare  crew  OW  with  TAWL  predictions  required 
that  they  combine  the  predictions  across  components  and  time 
to  produce  a  single  workload  index  comparable  to  OW.  The 
researchers  assumed  simple  additivity  and  summed  the  UH-60A 
predictions  across  time  and  components  to  generate  an  esti¬ 
mate  of  OW  for  each  crewmember  during  each  segment .  The 
correlations  between  the  subjective  OW  observed  by  lavecchia 
et  al .  and  the  OW  predicted  by  the  UH-60A  model  were  high 
(£  =  .82  to  . 95) . 

During  the  present  workload  analysis  of  the  UH-60A,  TOSS 
was  used  to  implement  a  regression  equation  derived  from  the 
data  reported  by  lavecchia  et  al.  (1989),  to  scale  the  OW 
predicted  by  TAWL  into  the  0-100  range  used  for  OW.  For  all 
mission  segments  described  in  this  report,  TOSS  computed  the 
predicted  OW  using  the  following  equation: 
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where  AUD,  KIN,  VIS,  NVG,  COG,  and  PSY  represent  the  mean 
auditory,  kinesthetic,  visual-unaided,  visual-aided,  cogni¬ 
tive,  and  psychomotor  workload  for  the  segment. 

Several  points  should  be  made  about  this  regression 
equation.  First,  if  the  measure  of  model  validity  is  in  the 
degree  of  correlation  between  OW  and  UH-60A  component  aver¬ 
ages,  then  scaling  is  unnecessary.  The  equation  is  only 
useful  in  generating  predictions  of  aviator's  OW  from  TAWL 
workload  predictions.  Second,  the  relationship  between  the 
7-poinc  scales  used  to  generate  the  UH-60A  predictions  and 
the  0  to  100  OW  scale  is  unclear.  The  7-point  scales  were 
developed  to  estimate  the  workload  of  a  single  component  for 
a  single  task  over  a  half-second  time  period,  whereas  the  OW 
scale  was  developed  as  an  estimate  of  the  workload  for  all 
components  over  a  much  greater  period  of  time.  Furthermore, 
the  7-point  scales  have  a  nominal  overload  threshold  (the 
point  at  which  task  performance  is  expected  to  degrade)  of  8, 
whereas  it  is  unclear  where  this  point  is  on  the  OW  scale. 

If  the  0  to  100  scale  is  taken  to  represent  the  extent  of 
workload  experience  and  if  that  experience  includes  situa¬ 
tions  of  task  degradation  due  to  high  workload,  then  the 
overload  point  on  the  OW  scale  has  not  been  logically  or 
empirically  determined.' 


OW 


AUD  +  KIN  +  VIS  +  NVG  +  COG  +  PSY 
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Third,  this  regression  equation,  generated  from  empiri¬ 
cal  results,  differs  from  any  simple  scaling  equation  gener¬ 
ated  logically.  For  example,  the  slope  of  the  equation  that 
scaled  a  7-point  scale  to  a  100-point  scale  would  be  14.3, 
similar  to  the  slope  of  14.5  in  the  equation.  However,  the 
intercept  of  the  7-point  to  a  100-point  equation  would  be 
0.0,  whereas  the  intercept  of  the  OW  regression  equation  is 
7.5.  Thus,  if  all  TAWL  component  workload  predictions  were 
0.0,  the  equation  would  predict  pilot  QW  to  be  7.5. 

Regardless  of  the  possible  inaccuracies  of  the  empiri¬ 
cally  derived  OW  regression  equation,  it  is  currently  the 
only  link  between  the  workload  predictions  generated  by  a 
TAWL  prediction  model  and  an  overall  subjective  measure  of 
workload.  Therefore,  it  has  been  used  to  compute  an  overall 
estimate  of  aviator  workload  in  the  analyses  of  the  UH-60A, 
the  MH-60K,  and  their  comparison. 


Results 

Workload  prediction  graphs  for  the  pilot  and  copilot 
were  produced  for  each  of  the  34  UH-60A  mission  segments. 

The  graphs  present  the  total  workload  of  each  component  for 
all  tasks  the  crewmember  performs  during  each  half-second  of 
the  mission  segment.  An  example  of  a  pilot  segment  workload 
prediction  graph  is  presented  in  Figure  1.  Figure  1  shows 
estimated  workload  for  the  pilot  on  each  component  during  the 
Before  Takeoff  (External  Load)  [NVG]  segment  of  the  mission. 

A  brief  description  of  the  graph  for  each  component  in 
Figure  1  follows. 

Workload  associated  with  random  cockpit  communication 
can  be  seen  in  the  auditory  graph  as  a  pair  of  closely  spaced 
peaks  of  workload.  The  higher  peak  occurs  when  the  pilot 
receives  the  communication  and  the  lower  peak  occurs  when  the 
pilot  transmits.  The  kinesthetic  graph  initially  indicates 
low  workload  while  the  aircraft  is  on  the  ground  and 
increased  workload  at  the  time  (110  seconds  elapsed  time)  the 
pilot  initiates  a  hover  to  pick  up  the  external  load.  The 
NVG  (visual-aided)  graph  shows  that  the  pilot  experiences 
relatively  low  NVG  workload  until  he  begins  to  hover  the 
aircraft.  At  that  time  (110  sec.),  the  NVG  workload 
increases  as  the  pilot  shifts  attention  to  the  ground  guide 
for  directions  over  the  sling  load.  The  interruption  in  the 
NVG  workload  shortly  after  100  seconds  is  the  result  of  the 
pilot  checking  the  instruments  before  picking  the  aircraft  up 
to  a  hover.  This  instrument  check  is  also  indicated  by  the 
increase  in  unaided  visual  workload  at  the  same  elapsed  time 
on  the  visual  graph.  The  completion  of  external  load  hook-up 
can  be  seen  when  the  NVG  workload  decreases  between  400  and 
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Figure  1.  Example  of  a  pilot  segment  workload  prediction 
graph . 


450  seconds  of  elapsed  time.  At  this  time,  tne  pilot  ceases 
observing  the  ground  guide  and  returns  to  monitoring  outside 
the  aircraft.  The  cognitive  workload  is  low  when  the  pilot 
is  simply  monitoring  outside  the  aircraft  but  increases  when 
the  pilot  begins  to  hover  the  aircraft.  In  addition,  cogni¬ 
tive  workload  associated  with  cockpit  communication  can  be 
seen  as  a  pair  of  peaks  each  time  communication  occurs. 
Finally,  the  psychomotor  graph  indicates  the  workload  asso¬ 
ciated  with  moving  the  flight  controls  while  hovering  and  the 
switch  activation  required  to  communicate.  The  diamond  at 
the  end  of  each  graph  indicates  the  mean  component  workload 
for  the  entire  segment.  Appendix  A  presents  graphs  of  pilot 
workload  for  each  of  the  34  mission  segments .  Each  page 
displays  the  pilot  workload  for  one  segment  using  6  graphs, 
one  for  each  workload  component.  Appendix  B  presents  graphs 
of  copilot  workload  for  each  of  the  mission  segments. 

The  UH-60A  workload  model  predictions  for  the  pilot  and 
copilot  are  summarized  in  Tables  1  and  2,  respectively.  The 
tables  show,  for  each  of  the  34  segments,  the  number  of  over¬ 
load  conditions  (OC) ,  the  average  workload  for  each  of  the  6 
components,  and  the  predicted  OW. 

The  data  contained  in  the  tables  indicate  the  following: 

•  The  only  overload  condition  observed  during  the 
mission  occurred  during  the  NOE  and  the  contour  flight 
segments  when  a  threat  was  present  (overload  condi¬ 
tions  occurred  for  both  the  pilot  and  copilot  during 
these  segments) . 

•  The  pilot' s  average  kinesthetic  and  psychomotor  work 
load  is  higher  during  flight  segments. 

•  The  pilot's  average  OW  is  highest  in  the  Takeoff 
(External  Load)  segment. 

•  The  copilot's  average  cognitive  workload  is  higher 
when  performing  navigation  during  en  route  flight 
segments . 

•  The  average  copilot's  OW  is  highest  in  the  NOE  Flight 
(Mission  Change)  segment. 

•  Both  crewmembers'  average  OW  is  higher  during  flight 
segments . 

•  Proficient  crewmembers  can  perform  the  UH-60A  missions 
without  encountering  an  overload  condition,  except 
when  being  engaged  by  a  threat. 


Table 


Pilot  Workload  for  the  UH-60A  Model  by  Segment 


Segment 

OC 

AUD 

KIN 

VIS 

NVG 

COG 

PSY 

OW 

01 

Before  Takeoff  (Assembly  Area) 

0 

1.0 

1.4 

1.3 

C  ^ 

2.8 

C  .4 

23.6 

02 

Takeoff 

0 

2.7 

7.0 

2.0 

0.0 

3.6 

3.2 

52 . 1 

03 

Takeoff  [NVGJ 

0 

1.5 

7.0 

0.3 

1 .1 

2.8 

"5  ^ 

4  5  .  1 

O'? 

Contocr  Flight 

c 

1.3 

7.0 

1.9 

0.0 

3.2 

2  -  9 

46.6 

05 

Contour  Flignt  [NVG] 

0 

1.3 

7.0 

0.4 

0.9 

3.2 

2.9 

4  5.1 

C6 

Contour  Flight  (Threat) 

6 

1.3 

7.0 

2.0 

0.0 

3.3 

2 . 9 

4  7 . 2 

03 

Contour  Flight  (Threat)  INVC) 

1.3 

7.0 

0.4 

1 .0 

3.2 

2 . 9 

4  5.4 

CO 
c  > 

Contour  Flight  (Mission  Change) 

0 

1.3 

7.0 

1.9 

C  .0 

3.2 

2.9 

4  b  .  S 

C9 

Cor.to.r  iMissiori  Grange) 

0 

1.3 

7.0 

0.4 

0.9 

3.2 

2.9 

4  5  1’ 

1  z 

Approach 

c 

1.3 

7.0 

1.2 

0.0 

2.9 

2 . 9 

4  4.1 

1 

Approacn  ;nVG! 

0 

1.3 

7.0 

0.2 

0.9 

2.9 

2.9 

4  3  .  9 

2 

Lana :  ng 

c 

2.1 

6.6 

2.0 

C.O 

3.0 

2.9 

47.1 

3 

Landing 

A 

1.2 

6.8 

0.0 

1  .4 

2.6 

7.  .  8 

42  .  9 

14 

Before  Takeoff  (Internal  Load) 

c 

1.7 

1  d 

1.0 

0.0 

2.9 

C  .  4 

23.9 

5 

Before  Takeoff  (External  Load) 

0 

1 

5.1 

2.8 

C.O 

4  . 1 

2.1 

4  4.: 

1  e 

Before  Takeoff  (External.  Load) 

:  N'VG  ■ 

0 

0.9 

5.5 

0.1 

3.6 

4.0 

2.2 

46.6 

1 

Takes  f  f  (Externa  1 ) 

0 

3.5 

7.0 

2.2 

C.O 

4  .  9 

3 . 4 

5  7.9 

18 

Takeoff  (External)  [NVG) 

0 

2.7 

7.0 

0.9 

0.7 

3.5 

3.2 

5C  . 

9 

NOE  Flight 

0 

1.3 

7.0 

1.9 

0.0 

3.2 

2.9 

4  6.' 

2  0 

NOE  r'light  [NVG] 

0 

1.3 

7.0 

0.4 

0.9 

3.2 

2.9 

45.2 

21 

NOF,  Flight  (Threat) 

6 

1.3 

7.0 

2.1 

0 .0 

3.3 

2.9 

47.3 

22 

NOE  Flight  (Threat)  [NVGj 

2 

1.3 

7.0 

0.4 

1.0 

3.3 

2.9 

45.7 

23 

NOE  Flight  (Mission  Change) 

0 

0.8 

7.0 

2.0 

0.0 

2.7 

2.8 

44.2 

24 

NOE  Flight  (Mission  Change) 

0 

0.8 

7.0 

0.4 

0.9 

2.7 

2.8 

42.5 

2  5 

Approach  (LZ) 

0 

1.3 

7.0 

1.2 

0.0 

2.9 

2.9 

44  .  C 

26 

Approach  (LZ)  [NVG] 

0 

1.3 

7.0 

0.2 

0.9 

2.9 

2.9 

44  .0 

27 

Landing  (LZ,  'internal  Load) 

0 

1.2 

6.5 

2.1 

0.0 

2.6 

2  .7 

4  3.6 

28 

Landing  (LZ,  Internal  Load) 

[NVGj 

1.1 

6.6 

0.1 

1.4 

2.5 

2.7 

41.4 

29 

Landing  (LZ,  External  Load) 

0 

1.3 

6.5 

2.2 

0.0 

2.8 

2.8 

44 . 6 

3G 

Landing  (LZ,  External  Load) 

fNVG] 

0 

1.2 

6.6 

0.1 

1.4 

2.7 

2.8 

42.5 

31 

Before  Takeoff  (LZ) 

0 

2.0 

1.0 

0.0 

1.0 

3.2 

0.4 

25 . 6 

32 

FARP  Procedures 

0 

0.8 

3.1 

1.4 

0.0 

2.2 

1  .  1 

28.2 

33 

FAR?  Procedures  [NVG] 

0 

0.7 

3.8 

0.2 

0.9 

2.2 

1  .4 

2  9.1 

34 

Before  Takeoff  (FARP) 

0 

2.8 

1.0 

1.0 

0.0 

3.1 

0.7 

28 . 1 

5'gt 

2.  The  following  abbreviat ions  are 

used 

as  eolumn  headings 

in  Table 

1:  OC  = 

Ove  r  I 

oad 

Condition,  AJD  =  A’jditory,  KIN  =  Kines 

thetic,  VIS 

=  Visual 

-unaided,  NVG 

=  Vi sua 1 

-a :  dod 

,  COG  - 

Ccgr.inive,  PSY  ^  Psychomotor,  OW  -  Overall  Workload. 
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Table  2 


Copilot  Workload  for  the  UH-60A  Model  by  Segment 


beoT'e 

r-t 

OC 

ADD 

KIN 

VIS 

NVG 

C  OG 

PSY 

OW 

o  >  ^ 

Before  Takeoff  (Asse.-rbly  Area) 

0 

1.1 

0.1 

4.0 

0.0 

2.8 

3  . 5 

34 . 9 

d  • 

Tak'^^f  f 

Q 

2.1 

0.2 

1.6 

0 .0 

3  . 1 

C  .  4 

26.6 

3  3  : 

Takecff  [tiVG] 

C 

1.5 

0.1 

0.5 

1.2 

2.3 

3 . 2 

21.3 

Zcr.\cJ.r  Flight 

c 

1.3 

0.1 

4.8 

0.0 

6.1 

2  .  6 

42 . 9 

V  r  : 

C  c  :i  *  r  ?'  I  i  q  n  t  IN  VG  1 

c 

1.5 

C.l 

3.7 

0.8 

6 . : 

2.4 

42  .  1 

V  c  ■. 

"crfoor  Flight.  (Threat:) 

6 

1.3 

0.1 

4.7 

0 .0 

5.9 

2.4 

47 . : 

:  '■ : 

C'r. tear  rligr. t  (Threat)  [NVG] 

3 

1.3 

0 . 1 

3.5 

: .  1 

6  .  C 

7 . 1 

4  1.4 

3  h  : 

;'ot';;,,.r  Flight  (Mission  Change) 

0 

1.5 

C  .  1 

4.4 

0  .  c 

b  .  t 

3  .  C 

42.1 

:  -  : 

7cr.tc-ir  r-.cr.t  (Xission  Charge) 

Q 

1 . 5 

c.l 

3.8 

C  .4 

5  .  t 

3  .  7 

4  1.9 

Arrrn.jon 

n 

1 . 5 

c.l 

1  2 

C.C 

1  .  5 

C  .  / 

1  ?  . 

^  1  : 

Arrrcacr;  :NVG. 

3 

1  .6 

C .  1 

C.3 

0.8 

:  .7 

C  .  7 

1  9 .  t 

1 .  a  r, ::  i  r,  c 

c 

2.'; 

C  .2 

3.6 

3 . 3 

;  .5 

C  7 

19.1 

lang.ng  \V2 1 

r\ 

w 

: 

c . : 

0.2 

1  .  4 

2.2 

if 

7  7.. 

hertre  la<ecff  (’.rterr.al  I-oad) 

n 

2.0 

c.l 

4.5 

C.C 

7  .  7 

; . : 

3  7.1 

!.  : 

.Before  Takeoff  (Exte"'al  Load) 

V 

1.2 

C .  'i 

2.6 

C  .  C 

I  . 

C  .  9 

27.2 

'  : 

bf.'fcre  Taxes  ff  (Externa.  Toad) 

T 

3.0 

c.l 

1.5 

0.7 

1  .4 

2 : .  1 

■;  a  <  e  c  f  ;  { ■•  x  t  c  r  r.  a  . ) 

c 

3.5 

0.3 

2.2 

C  .  0 

4  .  C 

3  3.6 

^  “  : 

T.axcoff  (External)  [SVC. 

c 

2.7 

0 . 3 

*  C. 

i.  • 

0  .  b 

3  . 1 

c 

2  8.2 

F.ight 

c 

i  .3 

C  .  : 

4.8 

3 , 0 

t  .  4 

7 

4  4  .  4 

M'F  1  ;  icrnt  1  hVT  ; 

1.3 

3 . 1 

4  .  4 

3  .  4 

6.4 

^  .  z 

4  3  .  b 

i  : 

Mi  .-lion:  (Tnreat) 

6 

1.5 

3  . 1 

4.6 

3  . 3 

6  .  1 

4  7.7 

.  / 

h*:gr:  (Threat)  :nvG; 

2 

1 . 5 

d  <  1. 

4.2 

0.4 

6  . 7 

2.3 

42.5 

3  : 

t.lF  F.iqht  (Mission  Change) 

c 

1.0 

I'.  ^ 

5.0 

3 . 0 

6  .  C 

3.3 

44.5 

Mli  i'.iqht  (.Mission  Change) 

U 

1  Q 

V  .  i 

4.7 

c.3 

6  .0 

3 . 6 

4  b  .  2 

:  =  : 

Apcrcacn  (IZI 

n 

1.3 

0.1 

1.3 

C.C 

I  .  8 

:  .2 

IS.' 

;  6  : 

Appreaer,  (LZ)  INVG; 

0 

1  3 

0.1 

0.4 

C  .  9 

.  9 

3 . 7 

18.6 

7-  ' : 

Larding  (LZ,  Internal  Load) 

0 

1.2 

n  "! 

1.5 

C.C 

^  1 

"k 

18.5 

78: 

Tar.a^rg  (TZ,  Ir,  ternai  Lodd) 

0 

i  .  1 

c.l 

0.4 

1  /• 

1  .  ‘t 

: .  9 

L<  •  3 

19.4 

■  \  Yg  ■ 

?9: 

Landing  (LZ,  External  Load) 

Q 

1 .3 

O.I 

1.5 

0.0 

1  .8 

C  .  3 

19.2 

3  3  : 

Lar.dirg  (hZ,  External  Load) 

c 

1.2 

c.l 

0.4 

:  .4 

7 . 3 

3  .  3 

.'C.C 

3  : 

Before  Takeoff  (LZ) 

c 

2.C 

0.1 

?  ° 

vl  .  C 

7  .  ' 

3  -P 

2  ' 

3  7  : 

?  .A  h  P  r  r  c  e  0  1  r  e  s 

c 

0.8 

n 

O'  •  .A 

0.5 

0 , 3 

1  .  7 

3  .  I 

’  g 

r'A*'-'  ?  r  t '"eo rr*  f,  ' \VG 

n 

0.7 

C .  i 

O.i 

0  .  T 

I  . 

3 . : 

13.8 

3  ■'  : 

hefere  Tdkeohf  (FARPi 

n 

v> 

3.7 

0.2 

2.6 

0.0 

2.4 

:  .7 

3  1.8 

^  C  L  o  . 

T  f  c  !  i  (D  w.  r,  n  a  b  b  r  e  v  i  a  t  i  o  r.  s  are 

JS" 

d  as  coin 

rr.n  head 

inqs 

in  T a b ■ e 

I  :  OG  ^ 

G  vt?  r  . 

'ad 

t;  r,  ALL  -  A.m-ory,  KTN  -  Ktnes 

t.  net 

ic,  VIS  - 

Vi sua 1 

-t:na 

aed,  NVG 

V  ;  rua  . 

-cl  ;  n d 

,  COG 

. '.'r  ,  PSY  P  r.  V''.:.'.cr  c  t  o  r  ,  ';W  -  Cve 

ra  1  i 

We  rk I oaa 
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ANALYSIS  II 


THE  MH-60K  WORKLOAD  PREDICTION  MODEL 


The  MH-60K  workload  prediction  model  was  developed  with 
the  same  procedures  as  the  UH-60A  model  (Bierbaum,  Szabo,  & 
Aldrich,  1989) .  The  following  section  includes  a  full 
description  of  the  TAWL  methodology  used  for  the  MH-60K  for 
the  benefit  of  the  reader  not  in  possession  of  the  previous 
report.  The  section  also  includes  the  results  of  exercising 
the  TOSS  software  in  the  analysis  of  workload  for  the  MH-60K 
aircraft  and  a  comparison  of  MH-60K  and  UH-60A  operator 
workload  predictions. 


Method 

Mission/Task/Workload  Analysis 

The  mission  tasks  and  workload  for  both  the  pilot  and 
copilot  were  analyzed.  The  analytic  tasks  are  listed  below 
in  the  order  in  which  they  were  performed: 

•  develop  a  composite  mission  scenario, 

•  divide  mission  into  phases, 

•  divide  mission  phases  into  segments, 

•  identify  functions  in  the  mission  segment, 

•  identify  tasks  for  each  function,  and 

•  analyze  individual  tasks. 

A  diagram  of  the  taxonomy  used  in  the  top-down  analysis  of 
the  MH-60K  mission  is  shown  in  Figure  2.  Each  of  the 
analytic  steps  is  described  in  the  following  subsections. 


Develop  a  Composite  Mission  Scenario 

The  first  step  in  conducting  the  MH-60K  mission/task/ 
workload  analysis  was  to  develop  a  composite  mission  sce¬ 
nario.  A  composite  mission  is  a  combination  of  the  unique 
operations  present  in  several  typical  riK-60K  m.issioi'ia.  A 
composite  mission  scenario  was  developed  for  the  MH-60K  from 
unique  mission  profiles  that  differed  in  the  following  ways: 

•  the  mode  of  flight  (en  route,  contour,  NOE) , 

•  the  presence  of  a  threat  during  flight,  and 

•  the  receipt  of  mission  changes  during  flight. 

Information  from  three  sources  was  used  to  develop  the 
scenario:  (a)  the  International  Business  Machines  Integrated 

Avionics  Subsystem  (IAS)  technical  proposal,  (b)  the  IAS 
control  layer  formats,  and  (c)  interviews  with  160th  SOAG 
UH-60A  SMEs .  The  researchers  made  three  assumptions  in 
developing  the  mission  scenario.  First,  the  prototypical 
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Figure  2.  Diagram  of  the  taxonomy  used  in  the  top-down 
analysis  of  the  MH-60K  mission. 


mission  fc r  the  MH-60K  aircraft  is  to  support  special  opera¬ 
tions  by  transporting  personnel  and  Internal  cargo  at  night. 
Second,  the  pilot's  primary  role  is  to  fly  the  aircraft  and 
the  copilot's  primary  role  is  to  assist  the  pilot  and  to 
perform  navigation  functions.  Third,  the  mission  is  flown 
under  optimal  conditions  (i.e.,  full  moon  with  no  degrada¬ 
tions  due  to  weather  or  equipment) .  By  assuming  optimal 
conditions  for  the  mission,  the  most  conservative  estimates 
of  workload  are  produced.  That  is,  if  excessive  workload 
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occurs  during  optimal  conditions,  excessive  workload  also 
would  be  expected  during  degraded  conditions. 

The  resultant  MH-60K  mission  is  depicted  schematically 
in  Figure  3.  Dashed  rectangles  represent  mission  phases; 
solid  rectangles  represent  mission  segments.  The  MH-60K 
mission  begins  at  a  base  where  the  crew  performs  preflight 
and  departure  operations.  The  pilot  then  flies  contour 
flight  from  the  base  to  a  rendezvous  point  where  air-to-air 
refueling  operations  are  performed.  After  completing  the 
refueling  operations,  the  pilot  flies  NOE  to  the  landing  zone 
(LZ) ,  where  combat  troops  are  inserted  or  cargo  is  delivered. 
After  completing  the  troop  and/or  cargo  delivery,  the  pilot 
flies  NOE  back  to  a  rendezvous  point  for  air-to-air  refuel¬ 
ing.  Upon  completion  of  the  second  refueling  operation,  the 
pilot  flies  contour  back  to  the  base,  where  postflight 
activities  are  conducted. 

Although  the  activities  and  conditions  encountered  on 
any  given  mission  may  differ  from  those  described  above,  the 
phases  of  the  mission  adopted  for  this  research  are  represen¬ 
tative  of  tactical  missions  for  the  MH-60K  aircraft.  Fur¬ 
thermore,  the  scenario  developed  for  the  MH-60K  analysis  is 
highly  similar  to  the  scenario  and  conditions  used  to  develop 
the  UH-60A  workload  prediction  model  (Bierbaum,  Szabo,  & 
Aldrich,  1989) .  The  close  correspondence  between  the  UH-60A 
mission  and  the  MH-60K  mission  facilitated  the  comparison  of 
workload  predictions  for  the  UH-60A  and  MH-60K  aircraft. 


Divide  Mission  Into  Phases 

Once  the  mission  was  identified,  it  was  divided  into 
temporally  discrete,  uninterruptible,  and  nonrepeating  divi¬ 
sions  called  phases.  A  phase  is  defined  as  a  required,  logi¬ 
cal  part  of  a  mission  that  may  be  accomplished  in  several 
ways.  Phases  must  be  performed  sequentially  (i.e.,  phases 
cannot  be  performed  concurrently)  and  must  be  contiguous. 

All  portions  of  the  mission  are  encompassed  under  one  of  the 
mission  phases  and  every  phase  must  be  performed  to  accom¬ 
plish  the  mission.  Thus,  the  mission  consists  of  a  sequence 
of  phases  placed  end  to  end  (see  Figure  3) . 


Divide  Mission  Phases  Into  Segments 

The  mission  phases  were  divided  into  temporally 
discrete,  uninterruptible  parts  called  segments.  A  segment 
represents  a  particular  method  of  accomplishing  a  part  of  a 
phase .  Segments  must  be  sequential  to  other  segments  and 


15 


PHASE  1 t 

DEPARTURE  (BASE) 


PHASE  2: 

ENROUTE 

(BASE-RENDEZVOUS) 


PHASE  3: 

ENROUTE 

(RENDE2VOUS-LZ) 


PHASE  4: 
ENROUTE 

(LZ-RENDEZVOUS) 


PHASE  5: 

ENROUTE 

( RENDEZVOUS- BASE) 


Note .  The  following  abbreviations  are  used  in 
ANVIS  =  Aviator's  Night  Vision  Imaging  System; 
Survivability  Equipment;  LZ  =  Landing  Zone. 


Figure  3: 

ASE  =  Aircraft 


Figure  3.  Schematic  diagram  of  the  MH-60K  composite  mission 
scenario . 
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must  be  contiguous.  Different  segments  may  represent  differ¬ 
ent  methods  for  accomplishing  the  same  portion  of  a  phase; 
thus,  every  segment  identified  for  a  phase  may  not  be  needed 
to  complete  that  phase.  A  segment  defined  for  one  phase  may 
appear  in  one  or  more  other  phases.  Takeoff  [ANVIS]  is  an 
example  of  a  segment  that  appears  in  more  than  one  mission 
phase . 


Identify  Functions  in  the  Mission  Segments 

The  next  step  was  to  identify  all  interruptible  parts  of 
segments,  which  are  called  functions.  A  function  is  defined 
as  a  collection  of  a  crewmember's  actions  that  are  necessary 
to  carry  out  a  single  logical  activity.  The  same  function 
may  be  performed  in  different  segments.  Functions  can  be 
performed  concurrently  or  sequentially.  Examples  of  func¬ 
tions  are:  Establish  Hover,  Monitor  Threat,  Perform  Navi¬ 
gation,  and  Check  Flight  Parameters.  For  each  function 
identified  during  mission  decomposition,  a  Function  Analysis 
Worksheet  was  developed  to  organize  the  information  gained 
from  the  analysis.  Figure  4  presents  an  example  of  a 
Function  Analysis  Worksheet. 


Identify  Tasks  for  Each  Function 

The  lowest  level  of  mission  decomposition  is  the  task. 
Tasks  are  defined  as  the  uninterruptible  crew  activities  that 
are  required  for  the  successful  completion  of  a  function. 
Tasks  can  be  performed  concurrently  or  sequentially.  Each 
task  identified  for  a  particular  function  was  listed  on  the 
Function  Analysis  Worksheet  for  that  function.  Tasks  were 
described  by  verbs  and  objects,  which  were  listed  in  the 
first  two  columns  of  the  worksheet.  The  verb  described  the 
crewmember's  action;  the  object  described  the  recipient  of 
the  action.  Examples  of  verbs  include  check,  set,  position, 
monitor,  and  release;  examples  of  objects  include  switches, 
knobs,  helmets,  and  maps. 


Analyze  Individual  Tasks 

Each  task  was  analyzed  separately  to  produce  the  infor¬ 
mation  required  to  develop  the  workload  prediction  model. 

For  each  task,  the  analysts  identified  the  crewmember  who 
performed  the  task,  the  subsystem  used  to  perform  the  task, 
the  workload  imposed  by  the  task,  and  the  duration  of  the 
task.  The  task  data  were  entered  on  a  Function  Analysis 
Worksheet  prepared  for  each  function.  Figure  4  presents  the 
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MH-60K  FUNCTION  ANALYSIS  WORKSHEET 
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Figure  4.  Example  of  an  MH-60K  Function  Analysis  Worksheet. 


data  for  each  of  the  tasks  identified  in  the  mission  function 
entitled  "Perform  IFF  Procedures."  Figure  4  is  referred  to 
in  the  following  paragraphs,  which  describe  how  the  task  data 
were  derived,  and  in  the  subsequent  subsection,  which 
describes  the  procedures  used  to  develop  the  workload  predic¬ 
tion  model. 

The  verbs  and  objects  defining  the  tasks  are  presented 
in  Columns  1  and  2,  respectively,  of  the  Function  Analysis 
Worksheet .  The  remaining  columns  present  data  on  each  of  the 
following : 

•  crewmember (s)  performing  the  task, 

•  task  identifiers, 

•  the  subsystem (s)  on  which  the  task  is  performed, 

•  the  estimated  workload  imposed  by  the  task,  and 

•  the  task  duration. 

The  procedures  used  to  derive  these  data  are  described  below. 

Identify  crewmember (s) .  Once  the  tasks  for  each  func¬ 
tion  were  identified,  the  analyses  identified  the  crewmembers 
performing  the  task.  Specifically,  each  task  within  a  given 
function  was  assigned  to  the  pilot,  copilot,  or  both  crew¬ 
members.  SMEs  made  the  assignments.  In  general,  all  flight 
control  tasks  were  assigned  to  the  pilot;  all  navigation  and 
support  tasks  were  assigned  to  the  copilot. 

On  the  Function  Analysis  Worksheets,  tasks  performed  by 
the  pilot  were  indicated  by  the  letter  "P"  in  the  third 
column;  similarly,  tasks  performed  by  the  copilot  were 
indicated  by  the  letter  "C."  For  example.  Column  3  in  Figure 
4  indicates  that  the  copilot  performs  the  task  "Check  IFF 
Code .  " 


Task  identifier.  Numerical  identifiers  for  each  task 
are  presented  in  Column  3  following  the  crewmember' s 
identification . 

Identify  subsystem(s) .  The  next  step  in  the  analysis 
was  for  SMEs  to  identify  the  subsystem (s)  associated  with 
each  task.  The  subsystems  identified  for  the  tasks  were 
listed  in  the  fourth  column  of  the  Function  Analysis  Work¬ 
sheets.  For  example,  the  task  Check  IFF  Code  in  Figure  4  is 
associated  with  the  Control  Display  Unit  and  the  Transponder. 

Estimate  workload.  Workload,  as  the  term  is  used  in 
this  research,  is  defined  as  the  total  attentional  demand 
placed  on  the  operators  as  they  perform  the  mission  tasks . 
Consistent  with  Wickens'  theory  of  human  information  process¬ 
ing,  human  attention  is  viewed  as  a  multidimensional 
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construct  of  limited  availability  (Wickens,  1984)  .  This 
research  methodology  recognizes  three  different  components  of 
attention:  cognitive,  psychomotor,  and  sensory.  Thus,  work¬ 

load  is  the  demand  on  each  of  these  components  imposed  by  all 
the  tasks  an  operator  is  performing  currently.  The  method¬ 
ology  further  assumes  that  each  of  these  components  is  a 
limited  resource  that,  when  expended,  will  result  in  degraded 
task  performance  or  task  shedding.  Cognitive  workload  (COG) 
refers  to  the  level  of  information  processing  required  of  the 
operator;  psychomotor  workload  (PSY)  refers  to  the  complexity 
of  the  operator's  behavioral  responses;  sensory  workload 
refers  to  the  complexity  of  the  visual-unaided  (VIS) ,  visual- 
aided  (NVG) ,  auditory  (AUD) ,  and/or  kinesthetic  (KIN)  stimuli 
to  which  an  operator  must  attend. 

To  derive  a  workload  estimate  for  each  task,  the 
analysts  first  identified  the  specific  workload  components 
(i.e.,  cognitive,  psy'chomotor,  auditory,  visual-unaided, 
visual-aided,  and  kinesthetic)  that  applied  to  each  task. 
Then,  they  wrote  a  short  verbal  description  of  the  atten- 
tional  demands  imposed  on  each  component.  Often  the  perfor¬ 
mance  of  a  task  imposed  demands  on  several  components.  For 
example,  consider  the  task  of  setting  a  switch  in  the  cock¬ 
pit.  First,  cognitive  attention  is  required  to  decide  that  a 
new  switch  position  is  necessary.  Next,  psychomotor  atten¬ 
tion  is  expended  to  move  the  switch.  Finally,  visual  atten¬ 
tion  may  be  required  to  ensure  that  the  switch  was  placed  in 
the  correct  position.  The  verbal  descriptions  of  the  atten- 
tional  demands  imposed  by  a  task  are  presented  in  Columns  5, 

6,  and  7  of  the  Function  Analysis  Worksheets. 

The  analysts  derived  estimates  of  component  workload  by 
comparing  the  verbal  descriptions  of  component  attentional 
deraand  with  verbal  anchors  on  corresponding  component  work¬ 
load  rating  scales.  Table  3  presents  the  workload  scales  for 
each  component.  Bierbaum,  Szabo,  and  Aldrich  (1989)  devel¬ 
oped  these  7-point,  equal-interval  rating  scales  for  use  in 
the  UH-60A  workload  analysis.  Although  all  the  component 
workload  scales  employ  the  same  numerical  values,  each  scale 
is  unique.  For  example,  although  both  the  NVG  and  the 
visual-unaided  tasks  require  the  use  of  eyes,  it  is  well 
known  that  NVG  tasks  require  more  attention  than  the  same 
tasks  performed  unaided  during  daylight.  The  effects  of 
system  modifications  are  compared  by  component.  The  intent 
is  not  to  compare  ratings  of  the  NVG  tasks  with  ratings  of 
the  visual-unaided  tasks  or  to  compare  auditory  tasks  with 
psychomotor  tasks . 

The  analysts'  task  was  to  select  the  verbal  anchor  that 
most  closely  matched  the  written  component  attentional  demand 
description.  The  rating  scale  value  associated  with  the 
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Table  3 


Workload  Component  Scales 


Scale  Verbal 
Value  Anchors 


Cognitive 

1.0  Automatic  (Simple  Association) 

1.2  Alternative  Selection 

3.7  Sign/Signal  Recognition 

4.6  Evaluation/ Judgment  (Consider  Single  Aspect) 

5.3  Encoding/Decoding,  Recall 

6.8  Evaluation/Judgment  (Consider  Several  Aspects) 

7.0  Estimation,  Calculation,  Conversion 

Psychomotor 
1 . 0  Speech 

2.2  Discrete  Actuation  (Button,  Toggle,  Trigger) 

2.6  Continuous  Adjustive  (Flight  Control,  Sensor  Control) 

4.6  Manipulative 

5.8  Discrete  Adjustive  (Rotary,  Verwlcal  Thumbwheel,  Lever 
Position) 

6.5  Symbolic  Production  (Writing) 

7.0  Serial  Discrete  Manipulation  (Keyboard  Entries) 

Visual-Unaided  (Naked  Eye) 

1.0  Visually  Register/Detect  (Detect  Occurrence  of  Image) 

3.7  visually  Discriminate  (Detect  Visual  Differences) 

4.0  Visually  Inspect/Check  (Discrete  Inspection/Static  Condition) 

5.0  Visually  Locate/Align  (Selective  Orientation) 

5.4  Visually  Track/Follow  (Maintain  Orientation) 

5.9  Visually  Read  (Symbol) 

7.0  Visually  Scan/Search/MonlLor  (Continuous/Serial  Inspection, 

Multiple  Conditions) 

Visual-Aided  (Night  Vi.sion  Goggle.s  ruvCI  ) 

1.0  Visually  Register/Detect  (Detect  Occurrence  of  Image)  With 

NVG 

4.8  Visually  Inspect/Check  (Discrete  Inspection/Static  Condition) 

With  NVG 

5.0  Visually  Discriminate  (Detect  Visual  Differences)  with  NVG 

5.6  Visually  Locate/Align  (Selective  Orientation)  With  NVG 

6.4  Vi.L  lally  Track/Follow  (Maintain  Orientation)  With  NVG 

7.0  Vis. ’.ally  Scan/Search/Monitor  (Continuous/Serial  Inspection, 

Multiple  Conditions)  With  NVG 

Continued  on  the  next  page 
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Table  3 


Workload  Component  Scales  (Continued) 


Scale  Verbal 
Value  Anchors 


Auditory 

1.0  Detect/Register  Sound  (Detect  Occurrence  of  Sound) 
2.0  Orient  to  Sound  (General  Orientation/Attention) 

4.2  Orient  to  Sound  (Selective  Orientation/Attention) 

4.3  Verify  Auditory  Feedback  (Detect  Occurrence  of 
Anticipated  Sound) 

4.9  Interpret  Semantic  Content  (Speech) 

6.6  Discriminate  Sound  Characteristics  (Detect  Auditory 
Differences ) 

7.0  Interpret  Sound  Patterns  (Pulse  Rates,  Etc.) 
Kinesthetic 

1.0  Detect  Discrete  Activation  of  Switch  (Toggle, 
Trigger,  Button) 

4.0  Detect  Preset  Position  or  Status  of  Object 
4.8  Detect  Discrete  Adjustment  of  Switch  (Discrete 
Rotary  or  Discrete  Lever  Position) 

5.5  Detect  Serial  Movements  (Keyboard  Entries) 

6.1  Detect  Kinesthetic  Cues  Conflicting  With  Visual  Cues 

6.7  Detect  Continuous  Adjustment  of  Switches  (Rotary 
Rheostat,  Thumbwheel) 

7.0  Detect  Continuous  Adjustment  of  Controls 


verbal  anchor  selected  was  assigned  to  represent  the  level  of 
workload  for  that  component  of  the  task. 

The  numerical  ratings  of  the  cognitive,  psychomotor,  and 
sensory  workload  associated  with  the  tasks  were  recorded  on 
the  Function  Analysis  Worksheet  immediately  below  the  corre¬ 
sponding  verbal  descriptions  of  component  attentional  demand. 
For  example,  the  numerical  rating  of  the  visual-unaided 
workload  associated  with  the  task  "Press  IFF  Key"  in  Figure  4 
is  3.7;  the  cognitive  workload  associated  with  the  task  is 
1.2;  and  the  psychomotor  workload  associated  with  the  task  is 
2.2.1 


iThe  type  of  switch  that  is  associated  with  a  specific  task 
is  a  correlate  of  workload.  Consequently,  for  each  task 
involving  a  switch,  the  type  of  switch  is  named  in  the 
eighth  column  of  the  Function  Analysis  Worksheet. 


K.st .1  mate?  task  duration.  As  the  final  step  in  the 
mission/task/workload  analysis,  the  analysts  estimated  the 
amount  of  time  required  to  perform  each  task.  The  duration 
of  each  discrete  task  was  recorded  in  Column  9  of  the  Func¬ 
tion  Analysis  Worksheet;  the  letter  "c"  was  placed  in  Column 
10  when  the  task  was  judged  to  be  a  continuous  task.  (Mis¬ 
sion  requirements  determine  the  duration  of  continuous 
tasks . )  The  total  time  required  to  perform  all  the  tasks  in 
a  function  was  tabulated  and  entered  in  the  upper  right 
corner  of  the  Function  Analysis  Worksheet.  The  duration  of 
functions  containing  continuous  tasks  generally  depend  upon 
the  segments  in  which  the  functions  occur.  For  these  func¬ 
tions,  the  word  "continuous"  was  entered  in  the  upper  right 
corner  of  the  Function  Analysis  Worksheet. 


Development  of  the  MH-60K  Workload  Prediction  Model 

The  mission/task/workload  analysis  described  above  used 
a  top-down  approach  to  identify  the  tasks  that  must  be  per¬ 
formed  to  meet  the  objectives  of  the  MH-60K  mission.  That 
is,  the  mission  was  progressively  decomposed  into  phases, 
segments,  functions,  and  tasks.  Tasks  represented  the  basic 
units  of  analysis  for  which  estimates  of  workload  and  time 
were  derived.  These  data,  in  turn,  make  up  the  data  base 
used  to  develop  the  MH-60K  workload  prediction  model. 

A  bottom-up  approach  was  used  to  develop  the  MH-60K 
workload  prediction  model.  The  approach  started  with  the 
basic  elements  produced  by  the  analysis  (i.e.,  the  tasks)  and 
successively  composed  the  mission  functions  and  segments. 

The  development  steps  are  listed  below  in  the  order  in  which 
they  are  performed: 

•  write  decision  rules, 

•  develop  computer  model,  and 

•  exercise  model  to  produce  estimates  of  workload. 

The  steps  performed  in  developing  the  model  and  producing 
estimates  of  workload  are  depicted  schematically  in  Figure  5. 


Write  Decision  Rules 

The  first  step  in  developing  the  workload  prediction 
model  was  to  write  decision  rules  for  composing  the  mission 
segments  from  the  task  data  base.  A  decision  rule  comprises 
the  information  necessary  to  schedule  a  task  or  function  in 
the  mission  (e.g,,  start  time  and  duration).  First,  function 
decision  rules  were  developed  for  combining  the  tasks  into 
functions.  Then,  segment  decision  rules  were  developed  to 
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MODEL  CONSTRUCTION 


Figure  5.  Bottom-up  flow  diagram  outlining  the  technical 
steps  performed  in  developing  the  MH-60K  workload  prediction 
model . 


combine  the  functions  into  segments.  The  function  and 
segment  decision  rules  provided  the  information  necessary  to 
reconstruct  the  mission  to  simulate  the  behavior  of  each 
crewmember  at  each  point  on  the  mission  timeline.  The 
procedures  used  to  develop  the  decision  rules  are  described 
in  the  following  subsections. 

Develop  function  decision  rules.  Function  decision 
rules  were  developed  for  each  of  the  functions  identified  in 
the  mission/task/workload  analysis.  The  decision  rules  were 
developed  in  two  stages.  During  the  first  stage.  Function 
Summary  Worksheets  were  developed.  Figure  6  presents  an 
example  of  a  Function  Summary  Worksheet.  Function  Summary 
Worksheets  describe  three  types  of  information.  First,  the 
crewmember  performing  each  task  was  indicated  by  placing  the 
task  name  and  number  in  a  column  under  the  appropriate  crew¬ 
member's  title.  Second,  the  approximate  temporal  relation¬ 
ships  among  the  tasks  were  portrayed  by  the  position  of  the 
tasks  on  the  worksheet:  tasks  placed  higher  on  the  page 
occurred  prior  to  tasks  placed  lower  on  the  page.  Concurrent 
tasks  were  placed  side  by  side.  Third,  the  task  category 


24 
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'e  6.  Example  of  an  MH-60K  Funclion  Summary  Worksheel. 


{discrete  fixed,  discrete  random,  continuous  fixed,  and 
continuous  random)  was  indicated  by  placing  the  task  category 
name  in  one  of  the  four  columns  below  each  crewmember's 
title.  For  complete  definitions  of  the  task  categories,  see 
Bierbaum,  Fulford,  and  Hamilton,  (1989). 

During  the  second  stage.  Function  Decision  Rules  Work¬ 
sheets  were  developed  from  the  Function  Summary  Worksheets. 

An  example  of  a  Function  Decision  Rules  Worksheet  is  pre¬ 
sented  in  Figure  7.  Function  decision  rules  were  developed 
that  specify  the  information  necessary  to  schedule  the  tasks 
in  the  function.  Decision  rules  for  discrete  fixed  tasks  and 
continuous  tasks  state  the  start  time  and  the  duration  of  the 
tasks  on  the  function  timeline.  In  addition  to  duration,  the 
decision  rules  for  discrete  random  tasks  state  the  proba¬ 
bility  and/or  frequency  of  the  random  tasks'  occurrence 
within  the  function. 

Develop  segment  decision  rules.  The  next  step  in  the 
development  of  the  model  was  to  write  the  segment  decision 
rules .  The  segment  decision  rules  comprise  the  information 
necessary  to  build  the  mission  segments  from  the  functions. 
The  segments  were  developed  in  two  stages:  first  by  devel¬ 
oping  Segment  Summary  Worksheets  and  then  by  developing 
Segment  Decision  Rules  Worksheets.  Figures  8  and  9  present 
the  Segment  Summary  Worksheet  and  the  Segment  Decision  Rules 
Worksheet  for  the  segment.  Rendezvous  [ANVIS] .  The  function. 
Perform  IFF  Procedures,  used  as  an  example  earlier  in  this 
report,  occurs  in  this  segment. 

As  illustrated  in  Figure  8,  the  Segment  Summary  Work¬ 
sheets  list  all  of  the  functions  performed  by  the  pilot  and 
the  copilot  during  a  mission  segment.  The  Segment  Summary 
Worksheets  also  identify  the  function  category  (discrete 
fixed,  discrete  random,  or  continuous  random)  and  the 
approximate  temporal  arrangement  of  the  functions  within 
segments.  Again,  see  Bierbaum,  Fulford,  and  Hamilton  (1989) 
for  the  complete  definitions  of  the  function  categories.  The 
Segment  Decision  Rules  Worksheets  contain  the  decision  rules 
that  define  the  onset  times  for  functions  and  their  duration. 


Develop  Computer  Model 

As  with  the  UH-60A,  the  TAWL  Operator  Simulation  System 
(TOSS)  was  utilized  to  implement  the  MH-60K  workload  model. 
The  mission/task/workload  analysis  data  entered  on  the  Func¬ 
tion  Analysis  Worksheets  and  the  function  and  segment  deci¬ 
sion  rules  constitute  all  the  information  necessary  for  TOSS 
to  generate  workload  predictions  for  crewmembers  of  the 
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Figure  9.  Example  of  an  MH-60K  Segment  Decision  Rules  Worksheet. 


MH-60K  aircraft.  The  development  of  the  TOSS  computer  model 
requires  the  entry  of  the  task  data  and  the  entry  of  function 
and  segment  decision  rules  into  TOSS.  These  data  entry  tasks 
are  depicted  in  the  task-flow  diagram  shown  in  Figure  5  and 
are  described  in  detail  below. 

Enter  task  data.  The  first  step  in  developing  the 
computer  model  was  to  enter  the  data  derived  during  the 
mission/task/workload  analysis  into  TOSS.  Specifically,  the 
following  data  were  entered: 

•  unique  mission  segment  names, 

•  unique  function  names, 

•  unique  task  names, 

•  subsystem  names  and  identifiers,  and 

•  the  component  (sensory,  cognitive,  and  psychomotor) 
workload  ratings  for  each  task. 

The  above  data  items  constitute  the  data  base  for  the 
simulation  of  the  MH-60K  mission. 

Enter  decision  rules.  The  second  step  in  developing  the 
computer  model  was  to  enter  into  TOSS  the  function  decision 
rules  and  segment  decision  rules  using  the  data  entry 
routines  of  the  system.  Specifically,  the  following  data 
were  entered  from  the  function  decision  rules  worksheets: 

•  task  start  time, 

•  task  duration, 

•  task  crewmember,  and 

•  task  frequency  for  random  tasks. 

Additionally,  the  following  data  were  entered  from  the  seg 
ment  decision  rules  worksheets: 

•  function  start  time, 

•  function  duration, 

•  function  interrupts, 

•  function  clash  pairs,  and 

•  function  frequency  for  random  functions. 

These  data  provided  the  TOSS  software  with  sufficient  infor 
mation  to  simulate  the  MH-60K  mission  and  predict  crew¬ 
members'  workload. 


Exercise  Model  to  Produce  Estimates  of  Workload 

The  analysts  used  TOSS  to  execute  each  of  the  15  unique 
mission  segments  in  the  MH-60K  model  to  simulate  operator 
task  performance  and  to  produce  estimates  of  the  total  work¬ 
load  experienced  by  each  crewmember  during  each  half-second 
of  the  mission.  TOSS  computes  the  total  workload  for  each 
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component  by  summing  the  ratings  assigned  during  the  task 
analysis  for  each  workload  component  (i.e.,  cognitive, 
psychomotor,  visual-aided,  visual-unaided,  auditory,  and 
kinesthetic)  of  each  concurrent  task. 


Results 

MH-6QK  Mission/Task  Analysis 

The  mission  scenario,  described  earlier,  was  divided 
into  five  mission  phases.  Preflight  and  postflight  opera¬ 
tions  were  excluded  from  the  UH-60A  baseline  analysis. 
Consequently,  the  analysis  for  the  MH-60K  began  with  depar¬ 
ture  from  the  base  and  ended  with  return  to  the  base.  The 
five  phases  included  in  the  analysis  are  listed  below  in  the 
order  of  their  occurrence  within  the  mission. 

•  Phase  1:  Departure  (Base) 

•  Phase  2:  Enroute  (Base-Rendezvous) 

•  Phase  3:  Enroute  (Rendezvous-LZ) 

•  Phase  4:  Enroute  (LZ-Rendezvous) 

•  Phase  5:  Enroute  (Rendezvous-Base) 

The  five  mission  phases  were  subsequently  divided  into 
mission  segments.  Fifteen  unique  segments  (i.e.,  segments 
that  are  distinctly  different  from  any  other  segment)  were 
identified  and  assigned  unique  two-digit  identifiers.  Three 
segments  were  found  to  occur  more  than  once  in  the  mission. 
The  number  of  segments  identified  in  each  of  the  five  mission 
phases  are  as  follows. 

•  Phase  1:  Departure  (Base)  -  3  segments 

•  Phase  2:  Enroute  (Base-Rendezvous)  -  4  segments 

•  Phase  3:  Enroute  (Rendezvous-LZ)  -  4  segments 

•  Phase  4:  Enroute  (LZ-Rendezvous)  -  4  segments 

•  Phase  5:  Enroute  (Rendezvous-Base)  -  3  segments 

The  specific  mission  segments  that  compose  each  of  the  five 
mission  phases  are  listed  in  Appendix  C. 

The  decomposition  of  segments  by  SMEs  resulted  in  the 
identification  of  a  total  of  71  unique  functions.  Each  of 
the  71  functions  was  assigned  a  unique  two-digit  identifier. 
The  number  of  functions  required  to  compose  each  segment 
ranged  from  8  to  17.  Appendix  D  presents  an  alphabetical 
list  of  the  71  functions  along  with  their  identifiers. 
Appendix  E  presents  the  functions  that  compose  each  of  the  15 
mission  segments. 

The  decomposition  of  the  71  functions  by  SMEs  resulted 
in  the  identification  of  230  unique  tasks.  The  number  of 
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tasks  required  to  compose  each  function  ranged  from  1  to  37 . 
The  230  unique  tasks  were  assigned  numerical  identifiers  from 
001  to  230.  Appendix  F  presents  an  alphabetical  list  of  the 
tasks  and  their  numerical  identifiers.  The  data  developed 
for  all  of  the  tasks  in  the  71  functions  are  shown  on  the 
Function  Analysis  Worksheets  presented  in  Appendix  G.  The 
Function  Summary  Worksheets  for  all  the  functions  in  the 
model  are  presented  in  Appendix  H.  The  Function  Decision 
Rules  Worksheets  for  all  the  functions  in  the  model  are 
presented  in  Appendix  I.  The  Segment  Summary  Worksheets  and 
the  Segment  Decision  Rules  Worksheets  for  the  15  mission 
segments  are  presented  in  Appendix  J  and  Appendix  K, 
respectively . 

A  total  of  21  subsystems  from  5  major  categories  were 
identified  for  the  MH-60K  mission  tasks.  Table  4  lists  these 
subsystems  along  with  their  respective  codes . 


MH-6QK  Workload  Predictions 

The  model  was  exercised  for  all  15  of  the  unique  seg¬ 
ments.  Under  the  assumed  conditions,  and  with  the  pilot  and 
copilot  sharing  task  requirements,  only  one  overload  condi¬ 
tion  was  predicted  for  each  crewmember.  The  overload  condi¬ 
tion  occurred  during  the  NOE  Flight  [ANVIS/ASE]  segment  when 
the  APR-39  was  activated.  Similar  to  the  UH-60A  findings, 
the  overload  occurred  as  a  result  of  the  crew  attempting  to 
communicate  as  the  APR-39  alert  was  sounding.  Thus,  the 
model  indicates  that  proficient  crewmembers  can  perform  the 
MH-60K  missions  without  encountering  overload  except  when 
engaged  by  a  threat.  Graphs  of  pilot  workload  for  all  15 
unique  segments  are  presented  in  Appendix  L.  Each  page 
displays  the  pilot  workload  for  one  segment  using  6  graphs; 
one  for  each  component.  The  copilot  data  are  presented  in 
Appendix  M. 

The  MH-60K  workload  model  predictions  for  the  pilot  and 
copilot  are  summarized  in  Tables  5  and  6,  respectively.  The 
tables  present  the  number  of  OCs,  the  average  workload  for 
each  of  the  six  components,  and  the  predicted  OW  for  all  15 
segments . 

The  data  contained  in  Tables  5  and  6  indicate  the 
following : 

•  The  only  overload  condition  observed  during  the 

mission  occurred  during  the  NOE  Flight  segment  when  a 
threat  was  present  (overload  conditions  occurred  for 
both  the  pilot  and  copilot  during  this  segment) . 
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•  The  pilot's  average  kinesthetic  and  psychomotor 
workload  is  higher  during  flight  segments. 

•  The  pilot's  average  OW  is  highest  in  the  Contour 
Flight  (Update)  segment. 

•  The  copilot's  average  cognitive  workload  is  higher 
when  performing  navigation  during  en  route  flight 
segments . 

•  The  copilot's  average  OW  is  highest  in  the  NOE  Flight 
(Route  Change)  segment. 


Table  4 

List  of  MH-60K  Subsystems 


Code  Subsystem 


E  ENGINE  SUBSYSTEM 

EF  Fuel 

EN  Engine 

F  FLIGHT  CONTROL  SUBSYSTEM 

FB  Brakes 

FC  Flight  Control 

FG  Gear 

MFD  Multifunction  Display 

N  NAVIGATION  SUBSYSTEM 

NA  Navigation 

NM  Maps 

NRA  Radar 

CDU  Control  Display  Unit 

MC  Multimode  Controller 

TP  Transponder 

U  UTILITY  SUBSYSTEM 

UAD  Advisory 

UC  Communications 

UL  Lighting 

US  Survivability 

DTU  Data  Transfer  Unit 

UCA  Cargo 

V  VISUAL  SUBSYSTEM 

VG  Night  Vision  Goggles 

ANV  Aviator's  Night  Vision  Imagery  System 

FLR  Forward-Looking  Infrared  (FLIR) 
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Table  5 


Pilot  Workload  for  the  MH-60K  Model  by  Segment 


Segment 

OC 

AUD 

KIN 

VIS 

NVG 

COG 

PSY 

cw 

01 

Configure  Systems  for  Mission 

0 

2.6 

1.0 

0.1 

1.0 

3.4 

0.7 

28.3 

02 

Before  Takeoff  (Base/Internal 
Load) 

0 

1.2 

4.7 

0.9 

1.8 

3.1 

1.9 

40.2 

03 

Takeoff  [ANVIS] 

0 

1.5 

7.0 

0.1 

2.0 

2.7 

3.0 

46.5 

04 

Enroute  Flight 

0 

1.1 

1.0 

0.5 

0.9 

3.1 

0.3 

23.5 

05 

Contour  Flight  (No  Update) 

[ANVIS] 

0 

1.3 

7.0 

0.5 

0.8 

3.4 

2.9 

45.7 

06 

Contour  Flight  (Update)  [ANVIS] 

0 

1.3 

7.0 

0.9 

0.8 

3.8 

2.9 

47.4 

07 

Rendezvous  [ANVIS] 

0 

1.1 

7.0 

0.5 

1.0 

3.4 

2.9 

45.6 

08 

NOE  Flight  [ANVIS] 

0 

1.3 

7.0 

0.1 

1.0 

3.1 

2.9 

44.2 

09 

NOE  Flight  [ANVIS/ASE] 

1 

1.3 

7.0 

0.1 

1.5 

3.1 

2.9 

45.5 

10 

Approach  (LZ)  [ANVIS] 

0 

1.3 

7.0 

0.2 

0.9 

2.9 

2.9 

43.9 

11 

Landing  (L2/Internal  Load) 

[ANVIS] 

0 

1.0 

6.6 

0.1 

2.5 

2.5 

2.7 

44.1 

12 

Before  Takeoff  (LZ) 

0 

1.8 

1.0 

0.0 

1.0 

3.1 

0.4 

24.9 

13 

NOE  Flight  (Route  Change)  [ANVIS] 

0 

0.8 

7.0 

0.1 

1.0 

2.5 

2.8 

41.5 

14 

Approach  [ANVIS] 

0 

1.1 

7.0 

0.2 

0.9 

2.8 

2.9 

42.9 

15 

Landing  [ANVIS] 

0 

1.2 

6.8 

0.1 

2.7 

2.7 

2.8 

46.2 

Table  6 


Copilot  Workload  for  the  MH-60K  Model  by  Segment 


Segment 

OC 

AUD 

KIN 

VIS 

NVG 

COG 

PSY 

Ci‘? 

01 

Configure  Systems  for  Mission 

0 

2.6 

0.2 

0.7 

0.0 

1.7 

0.7 

21.5 

02 

Before  Takeoff  {Base/Internal 
Load) 

0 

1.3 

0.1 

1.2 

0.2 

1.3 

0.7 

18.6 

03 

Takeoff  [ANVIS] 

0 

1.5 

0.1 

0.1 

1.2 

1.9 

0.1 

18.7 

04 

Enroute  Flight 

0 

1.3 

0.1 

3.5 

1.2 

5.6 

0.3 

35.8 

05 

Contour  Flight  (No  Update) 

[ANVIS] 

0 

1.5 

0.1 

3.2 

0.7 

5.5 

0.3 

34.1 

06 

Contour  Flight  (Update)  [ANVIS] 

0 

1.5 

0.1 

2.5 

1.5 

5.5 

0.3 

35.0 

07 

Rendezvous  [ANVIS] 

0 

1.4 

0.1 

2.4 

0.2 

3.3 

0.4 

25.8 

08 

NOE  Flight  [ANVIS] 

0 

1.3 

0.1 

3.3 

1.2 

5.9 

0.2 

36.0 

09 

NOE  Flight  [ANVIS/ASE] 

1 

1.3 

0.1 

2.0 

1.8 

5.5 

0.7 

34.7 

10 

Approach  (LZ)  [ANVIS] 

0 

1.4 

0.1 

0.1 

0.9 

1.9 

0.2 

18.1 

11 

Landing  (LZ/Internal  Load) 

[ANVIS] 

0 

1.2 

0.1 

0.3 

1.3 

1.9 

0.2 

18.9 

12 

Before  Takeoff  (LZ) 

0 

1.8 

0.1 

1.9 

0.0 

2.6 

0.6 

23.9 

13 

NOE  Flight  (Route  Change)  [ANVIS] 

0 

0.9 

0.2 

3.5 

1.3 

5.8 

0.3 

36.2 

14 

Approach  [ANVIS] 

0 

1.5 

0.1 

0.9 

0.6 

2.4 

0.3 

21.1 

15 

Landing  [ANVIS] 

0 

1.4 

0.1 

0.1 

1.3 

2.2 

0.2 

19.7 

Nnt--p  ■  The  following  abbreviations  are  used  as  column  headings  in  Tables  5  and  6:  OC  = 
Overload  Condition,  AUD  =  Auditory,  KIN  =  Kinesthetic,  VIS  =  Visual-unaided,  NVG  =  Visual- 
aided,  COG  =  Cognitive,  PSY  =  Psychomotor,  OW  =  Overall  Workload. 
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•  Both  crewmembers'  average  OW  is  higher  during  flight 
segments . 

•  Proficient  crewmembers  can  perform  the  MH-60K  mission 
without  encountering  an  overload  condition,  except 
when  being  engaged  by  a  threat. 


Comparison  of  MH-6QK  and  UH-6QA  Operator  Workload  Predictions 

To  estimate  the  effect  of  the  high  technology  modifi¬ 
cations  of  the  MH-60K  on  crewmember  workload,  12  segments 
from  the  MH-60K  mission  were  compared  to  12  like  segments 
from  the  UH-60A  mission.  Table  7  lists  the  compared  segments 
by  aircraft.  A  list  of  functions  in  each  segment  being 
compared  is  presented  in  Appendix  N. 

The  average  component  workloads  for  the  12  segments  of 
the  MH-60K  and  UH-60A  are  presented  in  Figures  10  and  11. 
Figure  10  presents  the  average  workload  by  component  for  the 
pilot  in  each  of  the  segments  being  compared.  Figure  11 
presents  the  average  workload  by  component  for  the  copilot  in 
each  of  the  segments. 


Table  7 

List  of  MH-60K  and  UH-60A  Segments  Compared 


MH- 

-60K  Segment 

UH-60A  Segment 

03 

Takeoff  [ANVIS] 

03:  Takeoff  [NVG] 

04 

Enroute  Flight 

05:  Contour  Flight  [NVG] 

05 

Contour  Flight  (No  Update)  (ANVIS] 

05:  Contour  Flight  [NVG] 

06 

Contour  Flight  (Update)  [ANVIS] 

05:  Contour  Flight  [NVG] 

08 

NOE  Flight  [ANVIS] 

20:  NOE  Flight  [NVG] 

09 

NOE  Flight  [ANVIS/ASE] 

22:  NOE  Flight  (Threat) 

[NVG] 

10 

Approach  (LZ)  [ANVIS] 

26:  Approach  (LZ)  [NVG] 

11 

Landing  (LZ,  Internal  Load) 

[ANVIS]  [NVG] 

28;  Landing  (LZ,  Internal  Load) 

12 

Before  Takeoff  (LZ) 

31:  Before  Takeoff  (LZ) 

13 

NOE  Flight  (Route  Change)  [ANVIS] 
[NVG] 

24:  NOE  Flight  (Mission 

Change) 

14 

Approach  [ANVIS] 

11:  Approach  [NVG] 

15 

Landing  [ANVIS] 

13:  Landing  [NVG] 
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□ 

UH-60A  - 

PILOT 

A 

MH-60K  - 

PILOT 

2  3  4  5  6  7  8  9  10  11  12  13  14  15  16 

MH-60K  Segment 


Figure  10.  Pilot's  average  component  workload  by  segment. 
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Psychomotor  Cognitive  NVG  Visual  Kinesthetic  Auditory 


□ 

UH-60A 

-  COPILOT 

A 

MH-60K 

-  COPILOT 

Figure  11.  Copilot's  average  component  workload  by  segment. 
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An  analysis  of  the  pilot  workload  by  component  graph 
(Figure  10)  indicates  little  difference  in  the  pilot  audi¬ 
tory,  visual-unaided,  or  cognitive  predicted  workload  for  the 
two  aircraft.  However,  the  kinesthetic,  NVG,  and  psychomotor 
workload  differed  in  certain  segments.  For  example,  when  all 
controls  for  the  MH-60K  are  coupled  during  contour  flight 
(Segment  04),  the  reduction  in  kinesthetic  and  psychomotor 
workload  is  significant .  The  small  increase  in  NVG  workload 
for  the  MH-60K  is  a  result  of  a  requirement  for  the  pilot  to 
spend  more  time  looking  outside  the  aircraft. 

The  copilot  workload  by  component  graph  (Figure  11) 
indicates  there  is  no  difference  in  the  copilot  auditory  or 
kinesthetic  predicted  workload  for  the  two  aircraft.  How¬ 
ever,  eliminating  the  requirement  in  the  MH-60K  for  the 
copilot  to  handle  maps,  determine  present  position,  and 
calculate  fuel  requirements  reduces  the  visual-unaided, 
cognitive,  and  psychomotor  workload  during  contour  and  NOE 
flight  (Segi  ents  05,  06,  08,  09).  This  change  also  enables 
the  copilot  to  spend  more  time  looking  outside  the  aircraft, 
which  produces  the  increase  in  NVG  workload. 

Predicted  OW  for  the  UH-60A  and  MH-60K  is  shown  in 
Figure  12.  The  top  figure  compares  the  pilot's  predicted  OW 
for  the  two  aircraft.  The  bottom  figure  compares  the 
copilot's  predicted  OW  for  the  two  aircraft. 

An  examination  of  the  pilot's  predicted  OW  graph  (Figure 
12)  shows  the  effect  of  control  coupling  during  contour 
flight  (Segment  04)  in  the  MH-60K.  An  examination  of  the 
copilot's  predicted  OW  graph  (Figure  12)  indicates  a  lower  OW 
for  the  MH-60K  in  nearly  all  segments.  This  finding  reflects 
the  copilot's  reduced  task  requirements  in  the  MH-60K,  except 
for  the  approach  and  landing  segments  (Segments  10,  11,  14, 

15)  . 
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Predicted  OW  Predicted  OW 


Figure  12.  Comparison  of  MH-60K  and  UH-60A  predicted  OW  by 
segment  for  the  pilot  (upper)  and  copilot  (lower) . 
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CONCLUSIONS 


The  workload  prediction  methodology  developed  by  ARIARDA 
provides  a  systematic  means  for  estimating  the  workload 
impact  of  the  advanced  technology  being  proposed  for  new 
aircraft  and  the  impact  of  modifications  of  existing  air¬ 
craft.  Under  the  conditions  assumed  during  model  development 
(e.g.,  proficient  operators,  optimal  weather  conditions) 
neither  the  UH-60A  nor  the  MH-60K  appears  to  place  excessive 
workload  demands  on  their  operators.  A  comparison  of  the 
workload  for  the  pilot  of  the  MH-60K  and  the  UH-60A  resulted 
in  the  following  observations: 

•  In  some  segments,  the  MH-60K  aircraft  was  found  to 
have  higher  NVG  workload  than  the  UK-60A.  The 
increase  in  external  visual  attention  may  provide  the 
MH-60K  pilot  with  increased  awareness  of  the  status 
and  spatial  location  of  the  aircraft,  of  other  air 
traffic,  and  of  threats  to  the  aircraft. 

•  The  MH  60K  aircraft  was  found  to  have  slightly  lower 
visual-unaided  workload  due  to  the  reduction  of 
aircraft  system  monitoring  which  is  automatically 
performed  by  the  integrated  avionics  subsystems. 

•  The  MH-60K  aircraft  was  found  to  have  reduced 
kinesthetic  and  psychomotor  workload  when  flight 
controls  are  coupled  during  Segment  04. 

•  The  overall  workload  in  the  MH-60K  was  found  to  be 
similar  to  the  UH-60A  in  all  segments  except  when  the 
controls  are  coupled  in  the  MH-60K. 

A  comparison  of  the  copilot  workload  for  the  MH-60K  and 
the  UH-60A  resulted  in  the  following  observations  > 

•  The  MH-60K  aircraft  was  found  to  have  reduced  visual- 
unaided  workload  due  to  the  reduced  requirements  for 
map  interpretation  because  present  position  is  always 
readily  available  on  the  MFD. 

•  The  MH-60K  aircraft  was  found  to  have  higher  NVG 
workload  than  the  UH-60A.  The  increase  in  external 
visual  attention  may  provide  the  MH-60K  copilot  with 
increased  awareness  of  the  status  and  spatial  location 
of  the  aircraft,  of  other  air  traffic,  and  of  threats 
to  the  aircraft. 
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•  The  MH-6CK  was  found  to  have  lower  cognitive  workload 
because  functions  such  as  fuel  consumption,  checking 
system  status,  and  determining  present  position  are 
performed  continuously  by  the  mission  processor. 

•  The  overall  workload  in  the  MH-60K  was  found  to  be 
generally  lower  than  the  overall  workload  in  UH-60A. 
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